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5 A METHOD AND A SYSTEM FOR PROGRAMMING AN IN- 
DUSTRIAL ROBOT 

FIELD OF THE INVENTION 

10 The present invention relates to a method for programming an 
industrial robot having a tool, to perform a process on an object 
while following a robot path defined by a number of waypoints. 
The process could be any type of surface processing application 
carried out by an industrial robot, such as painting, glazing, 

15 sanding, polishing, grinding, and welding. The invention is par- 
ticularly suitable for use in connection with teaching the robot a 
paint application. 

The present invention also relates to a computer program prod- 
20 uct directly loadable into the internal memory of a computer, 
comprising software code portions for performing the steps of 
the method according to the invention, when said product is run 
on a computer. 

25 The present invention also relates to a computer readable me- 
dium having a program recorded thereon, where the program is 
to make a computer perform the steps of the method according 
to the invention when said program is run on the computer. 

30 The present invention further relates to a system for use in con- 
nection with programming of an industrial robot, the system 
comprising information obtaining means, obtaining information 
about configuration data, tool speeds and a sequence of way- 
points comprising information about desired positions of the tool 

35 in relation to the object and desired positions of process events 
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in relation to the object and a storage unit, for storing the ob- 
tained information. 

PRIOR ART 

5 

Robots are often used for processing the surface of an object. 
Existing practice for programming a robot involves teaching the 
robot a sequence of waypoints. The waypoints define the path, 
which the robot shall follow during the processing of the object. 

10 A waypoint comprises three-dimensional position and three- 
dimensional orientation information. The robot is taught how to 
perform the task by being guided through the various waypoints 
along the desired operating path during the programming. The 
waypoints are specified in a first iteration and process related 

15 information, such as brush type and paint color, is added to the 
waypoint in a second iteration. The robot program is then gen- 
erated, based on the specified waypoints and the process infor- 
mation. The robot program is stored in a memory in the robot 
control unit. Then, the robot program is executed, and, if neces- 

20 sary, optimized after the robot has performed the operations. 
This programming method is described in the patent document 
US5327058. 

Generally, the robot is programmed to perform a task by an hu- 
25 man operator who manually jogs the robot to the desired posi- 
tions along the path using a movable programming unit, a so- 
called teach pendant. Commonly used programming methods 
using a teach pendant is described in the patent document 
US5327058. An industrial robot usually carries an end-effector 
30 comprising a tool for performing the processing, for instance a 
welding tool or a painting tool. During programming of the path, 
the operator has to position and orient the end-effector in each 
waypoint along the path. Teach-by show methods have the ad- 
vantage of indirectly utilizing implicit process knowledge of the 
35 operator during the programming. A disadvantage with traditio- 
nal manual teaching methods is that the control of the process 
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often is difficult to optimize. This is due to the fact that the op- 
erator does not get any feedback information before the robot 
program is executed. 

5 Alternatively, if a 3D CAD model of the object exists, a person 
with a computer scientist background teaches the waypoints in a 
robot simulation system, so-called off-line programming. The 
CAD approach is costly and not always intuitive to use. The 
complexity of the CAD-system requires the operator who is pro- 
10 gramming the robot to have knowledge about computer science. 
Such a person usually has little or no knowledge about the pro- 
cess. Either way, the teaching process is time consuming, trou- 
blesome, error prone, and in almost all cases requires several 
iterations before the program is acceptable. 

15 

All traditional methods for programming an industrial robot are 
focused on indicating the exact robot path in relation to the real 
object. The operator teaches the exact robot path and process 
events on this path instead of concentrating on the object. 

20 

SUMMARY OF THE INVENTION 

The object of the present invention is to provide an improved 
industrial robot programming solution that is easy and intuitive 
25 to use and that reducing the teaching time for the teaching proc- 
ess. 

According to one aspect of the invention, the object is achieved 
by means of the initially defined method, comprising: obtaining 

30 configuration data including configuration data for the tool, con- 
figuration data for the robot path and information about the posi- 
tion and orientation of the object in relation to the robot, obtain- 
ing a sequence of waypoints, which defines the process in rela- 
tion to the object, the waypoints comprises information about 

35 desired positions of the tool in relation to the object and desired 
positions of process events in relation to the object, obtaining at 
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least one distance for adjusting the position of a waypoint, auto- 
matically deciding whether an obtained waypoint should be mo- 
dified or not, based on the obtained information about the way- 
points, automatically generating a modified sequence of way- 
5 points by modifying the waypoints in the obtained sequence of 
waypoints, based on said decision, the obtained distance and 
the obtained information about the waypoints, and automatically 
generating the actual robot path based on the modified se- 
quence of waypoints, and the obtained configuration data. 

10 

By means of at least one computer, the complete robot path is 
automatically generated based on the operator's input. The op- 
erator teaches waypoints representing, positions, orientations 
and events in direct relation to the object. The operator inputs 

15 the waypoints in the specific order these will occur in the robot 
program. The operator only have to work with inputs directly at 
the surface of the object, unlike today's programming methods 
where the operator has to record the complete robot path that 
also exists outside of the object surface. The operator does not 

20 need to consider the real robot path, i.e. how long a distance 
out from the surface the robot needs to start the path or switch 
on the process. Thus, the programming becomes more intuitive 
and focused on the process and the object, instead of the robot 
path. Furthermore, the method reduces the total programming 

25 time, since less iterations is needed to achieve the robot path. 
The method according to the invention is suitable for off-line 
programming of the robot. 

According to an embodiment of the invention, the step obtaining 
30 the sequence of waypoints further comprises obtaining informa- 
tion about the position of a pointing member pointing at points 
on or in the vicinity of the object, storing the point being pre- 
sently pointed out by the pointing member as a waypoint upon 
receiving a recording signal, obtaining information about a proc- 
35 ess event, storing the information about the process event to- 
gether with the position of the waypoint, and determining the po- 
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sition of the points in relation to the object based upon said ob- 
tained information. By using a pointing member and pointing on 
the surface of the object, the operator will be able to teach the 
robot path in a single iteration and in the same way as he would 
5 use a tool, for example a paint-gun or a brush, and manually 
process the object surface. The total programming time is reduc- 
ed, due to the fact that it is possible to teach the waypoints in a 
single iteration. 

10 According to an embodiment of the invention, said modifying of 
waypoints is made based on a set of pre-defined rules. When 
generating the robot path for a certain process, several precau- 
tions must be taken during the programming procedure. To as- 
sure that these precautions are taken, the waypoints are modi- 

15 fied based on a set of pre-defined rules. 

According to an embodiment of the invention, the decision com- 
prises determining whether a waypoint comprises a specific pro- 
cess event and deciding that the waypoint should be modified if 

20 it does comprise the specific process event. Generally, a way- 
point should not be modified, if it does not include a process 
event. Only points including specific process events should be 
modified. For instance, if the waypoint comprises the process 
event "turn on the process" or "turn off the process", the way- 

25 point should be modified. 

An issue to be regarded in connection with painting is that when 
a paint stroke is to be started, the paint must be turned on some 
distance before the actual paint stroke is specified. This is ne- 

30 cessary due to the fact that there is a time delay from the paint- 
on command occurs until the paint hits the target and that the 
paint gun has a velocity vector in the direction of the paint 
stroke. In the same way, the paint needs to be turned off at a 
distance before the specified endpoint of the paint stroke. 

35 Again, due to the fact that the paint gun has a velocity vector in 
the direction of the paint stroke, and that there is a delay time 
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from the "paint off" command occurs until the application of paint 
ceases. 

Another issue to be regarded is that, in order to assure a high 
5 quality of the painting, the paint gun needs to have a velocity 
vector that is constant through the whole paint stroke. In order 
to accomplish this, the paint gun needs to be accelerated up to 
the desired speed in a correct direction before the paint is 
turned on and then the paint gun keeps the speed until the end 

10 of the paint stroke where the paint is turned off. Thereafter the 
paint gun needs to continue in the same direction for a distance 
while retarding. Normally, the operator solves this issue by 
specifying a point prior to where the paint is to be applied, in the 
direction of the paint stroke, so that the paint gun can reach the 

15 desired speed at the point where the paint starts to be applied. 

An advantage with the method according to the invention is that 
the operator does not need to bother about the issues men- 
tioned above; he only needs to specify the positions on the ob- 
20 ject where the process should start and stop. 

According to an embodiment of the invention, the distance ob- 
tained for adjusting the position of a waypoint is a point exten- 
sion distance that depends on the tool speed. The point exten- 

25 sion distance is the distance an obtained waypoint should be 
moved to assure that the tool is accelerated up to the desired 
speed before the process starts and the distance the tool needs 
to retard after the process has been turned off. The point exten- 
sion distance is either fed to the system by the operator or cal- 

30 culated by the system based on the obtained tool speed. In both 
cases, the point extension distance depends on the desired tool 
speed in the waypoints. 

According to an embodiment of the invention, the modifying of a 
35 waypoint comprises adding a new waypoint to the sequence of 
waypoints and determining a position for the new waypoint bas- 
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ed on said point extension distance and the obtained waypoints. 
Preferably, the determining of the new position for the waypoint 
comprises determining a direction based on the position of the 
current waypoint and the position of the previous waypoint, or 
5 the position of the current waypoint and the next waypoint, de- 
pending on the process event, and obtaining the new position by 
adding the point extension distance to the position of the ob- 
tained waypoint in the determined direction. 

10 For instance, if the operator has specified a waypoint at which 
the paint should be turned on, i.e. the waypoint comprises a po- 
sition and the process event "turn on the process", a new way- 
point has to be added before the specified waypoint, to assure 
that the paint gun should have accelerated up to the desired 

15 speed in the specified waypoint. The new waypoint is positioned 
backwards in the direction of a path described by the current, 
and the next waypoint at a distance equal to the point extension 
distance. If the process event is "turn off the process", the new 
waypoint is positioned forwards in the direction of a path de- 

20 scribed by the previous and the current specified waypoints, at a 
distance equal to the point extension distance. 

According to an embodiment of the invention, the obtaining of a 
distance for adjusting the position of the waypoint comprises ob- 

25 taining an event extension distance that depends on the tool 
speed and a delay time in connection with the process event. 
The event extension distance may either be provided by the op- 
erator or calculated by the system based on the tool speed and 
the delay time. The modifying of a waypoint comprises determin- 

30 ing a new position for the process event based on said event 
extension distance and the obtained waypoints, and moving the 
process event to the new position. For instance, if the operator 
specifies a waypoint with a position, at which the paint should 
start to be applied and the paint were turned on exactly at the 

35 specified position, the paint would start to be applied at a dis- 
tance after the specified position due to the paint gun speed and 
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the delay of the paint. Thus, a process event should not always 
happen exactly at the specified waypoint due to tool speed and 
process delay. Accordingly, the position of the specified way- 
point has to be modified. The exact position, where the event 
5 should occur, is automatically calculated by the system and the 
specified waypoint is moved to that position. 

According to an embodiment of the invention, the determining of 
the new position for the process event comprises determining a 

10 direction based on the position of the current waypoint and the 
position of the previous waypoint, or the position of the current 
waypoint and the next waypoint depending on the process 
event, and obtaining the new position by adding the event ex- 
tension distance to the position of the obtained waypoint in the 

15 determined direction. If a waypoint should be moved forward in 
a direction described by the previous and the current waypoints 
or backwards in a direction described by the current and the 
next waypoint depends on the process event. The distance that 
the point should be moved is equal to the point extension dis- 

20 tance. 

According to an embodiment of the invention, robot program 
codes are automatically generated based on the generated robot 
path. 

Preferably, the waypoints also comprise information about the 
orientation of the tool. According to an embodiment of the inven- 
tion, the method comprises copying the orientation of the last 
waypoint to the obtained waypoint upon request. When painting 
an object, going from waypoint to waypoint, it is often required 
to have the same orientation of the paint gun. It is therefore ad- 
vantageous to be able to copy the orientation of the last valid 
waypoint to the current waypoint specified. 

35 According to an embodiment of the invention, the method com- 
prises storing the obtained waypoint in a first waypoint list and 
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storing the modified sequence of waypoints in a second way- 
point list. This is done in order to remember the points specified 
by the operator in case the operator at a later occation wants to 
delete, change, or add a new waypoint. If the operator wants to 
5 edit a waypoint afterward, at least parts of the robot path has to 
be generated again, and the waypoints have to be modified 
again based on said set of pre-defined rules. 

According to a further aspect of the invention, the object is 
10 achieved by a computer program product directly loadable into 
the internal memory of a computer, comprising software code 
portions for performing the steps of the method according to the 
invention, when said product is run on a computer. The com- 
puter program product is provided either on a computer readable 
15 medium or through a network such as the Internet. 

According to another aspect of the invention, the object is 
achieved by a computer readable medium having a program re- 
corded thereon, where the program is to make a computer per- 
20 form the steps of the method according to the invention, when 
said program is run on the computer. 

According to still another aspect of the invention, the object is 
achieved by the initially defined system characterized in that it 

25 comprises means for deciding whether an obtained waypoint 
should be modified or not, based on the obtained information 
about the waypoints, means for generating a modified sequence 
of waypoints by modifying the waypoints in the obtained se- 
quence of waypoints, based on said decision, a distance for ad- 

30 justing the position of a waypoint and the obtained information 
about the waypoints, and a robot path generator, generating the 
actual robot path based on the modified sequence of waypoints, 
the tool speed and the obtained configuration data. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



The invention will now be explained more closely by the descrip- 
tion of different embodiments thereof and with reference to the 
5 appended figures. 

Fig. 1 shows an operator teaching a sequence of waypoints on 
an object using a pointing member. 



10 Fig. 2 is an illustration of a robot path and configuration data 
obtained in connection with the path. 
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Fig. 3 shows an example of a sequence of waypoints modified 
by a method according to the invention. 

Fig. 4 shows another example of a sequence of waypoints 
modified by a method according to the invention. 



Fig. 5 shows a robot path generated based on the modified se- 
20 quence of waypoints shown in fig. 4. 



Figs. 6 and 7 show flow charts of an embodiment of the method 
according to the invention. 

25 DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 
OF THE INVENTION 



Fig. 1 shows an example of system for use in connection with 
programming of an industrial robot according to the present in- 

30 vention. The system comprises a pointing member 1 utilized by 
a human operator 2 for off-line teaching the robot how to proc- 
ess an object 3. The pointing member can either be the process- 
ing tool itself, or preferably a device particularly adapted for the 
purpose of teaching the processing of the object. The pointing 

35 member could, for example, be a pen shaped device or an imita- 
tion of the processing tool, such as a paint-gun or a paintbrush. 
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The operator holds the pointing member 1 in his hand and points 
at the point he wants to include in the path and orientates the 
pointing member as he wishes the processing tool to be oriented 
5 in the point. The operator records a point by activation of an ac- 
tivation member, which generates a recording signal. Upon re- 
ceiving the recording signal the system stores the point as a 
waypoint. The position and orientation of the pointing member is 
for example determined the by means of image recognition. Al- 

10 ternatively, the pointing device may generate positions and ori- 
entations in a number of different ways. For example, the point- 
ing member can be a mechanical digitizer arm providing the po- 
sition and orientation of its tip or the pointing member may in- 
clude a sensor for determining position and orientation. Exam- 

15 pies of sensors and technologies for determining positions and 
orientations are accelerometers, gyros, magnetic trackers, ultra- 
sound, laser technology, vision-based tracking systems, and the 
Global Positioning System (GPS). 

20 The pointing member 1 comprises interaction means adapted for 
interaction between the operator and the system. One of the in- 
teraction means generates upon activation a recording signal for 
recording the point as a waypoint. Another interaction means is 
used for indicating whether the processing should be on or off 

25 between the waypoints. For example, if the process is painting, 
the interaction means indicates whether the paint is on or off. 
The system is also provided with means for input of information 
related to the process to the system such as brush type and col- 
or type. Alternatively, the processing can be defined as "on" or 

30 "off" depending on the process information. While teaching the 
robot, the operator records waypoints on the surface of the 
object and he also records process related information in 
connection with the waypoints. In relation to each recorded way- 
point, the operator indicates whether the processing should be 

35 on or off. 
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Information about position and orientation of the pointing mem- 
ber 1, and process data is transferred to a computer 4 including 
a processor and a memory. The output from the interaction 
means is either transferred via a wire or wirelessly from the 
5 pointing member 1 to the computer 4. The processor of the 
computer 4 is utilized for running algorithms generating the ro- 
bot path according to the invention and the memory is utilized 
for storing the obtained waypoints and the program instructions 
of the algorithms. 

10 

The teaching comprises teaching the robot how to perform the 
process by specifying a number of waypoints given in a specific 
sequence, describing the process in relation to the object. For 
instance the waypoints describe paint strokes on the surface of 

15 the object. The operator teaches the waypoints in a specific or- 
der related to the object surface. This order is relevant for the 
automatic generation of the robot path. A waypoint comprises 
desired position and orientation of the processing tool in the 
point, and data related to the process. The waypoint comprises 

20 either the recorded position and orientation, or the recorded po- 
sition and a copy of the last recorded orientation. When the op- 
erator teaches the path he first specifies a starting point for the 
robot path. The starting point is positioned at a distance from 
the object. Then the operator starts to specify points on the sur- 

25 face of the object. 

The operator may specify at least three points on or in the close 
vicinity of the object, specifying a plane. Waypoints laying on 
this plane may automatically receive orientation data in a pre- 
30 configured angle related to this plane and the programmed tool 
velocity vector. 

When the operator specifies a robot path, he positions the point- 
ing member to the desired waypoint and the position and the 
35 orientation of the pointing member is calculated related to the 
object coordinate frame. The operator uses the activation mem- 
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ber to set the desired brush type. The operator uses one of the 
activation members to specify that the desired point is to be 
stored in a waypoint list. In this embodiment, there are two pos- 
sibilities: if the button is pushed for a long period of time, both 
5 position and orientation are recorded. If the button is pushed 
and released immediately, only the position is recorded. The ori- 
entation will then be copied from the last valid orientation in the 
list of waypoints. 

10 Before the programming can start, certain configuration data 
need to be specified in the system. These configuration data will 
enable the system to calculate the real robot waypoints based 
upon the user specified waypoints. Either the operator feeds the 
configuration data to the system or some of the configuration 

15 data are previously stored into the system. The configuration 
data include a definition of the robot tool, a definition of the ob- 
ject coordinate system in relation to the robot co-ordinate frame, 
configuration data for the robot path, tool speeds and other 
relevant data. The definition of the robot tool comprises a defini- 

20 tion of the tool center point (TCP) and for example a list of 
available brush types with associated paint color. Typically, a 
brush type consists of paint flow and airflow parameters. The 
brush types are stored in an index brush table. One or several 
brush types can be defined as "process off", typically meaning 

25 that the paint flow is zero. 

The configuration data for the robot path includes a transport 
zone and a paint zone. A transport zone is the size of an arch 
combining two line segments of the path when the process is 

30 "off". A paint zone is the size of an arch combining two line seg- 
ments when the process is "on". The operator also has to feed 
information about desired tool speeds to the system. The tool 
speeds includes a transport speed, which is the tool speed of 
the tool when the process is "off", and a process speed, which is 

35 the tool speed when the process in "on". 
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For the modification of the waypoints a point extension distance 
and an event extension distance is needed. The point extension 
distance is a distance for extension of waypoints before and af- 
ter the process has been turned on or off. The size of the point 
5 extension distance is estimated in order to achieve an accelera- 
tion of the tool up to the desired tool speed before the process 
is turned on or to retard the tool after the process has been 
turned off. The event extension distance is a distance for exten- 
sion of an event due to the tool velocity and a delay time from 

10 the time when the tool is turned on or off until the process starts 
or stops. In this embodiment, the operator feeds the point ex- 
tension distance and the event extension distance to the sys- 
tem. In another embodiment the system calculates the point and 
event extension distances, based on the specified tool speeds 

15 and one or more delay times fed to the system. 

Alternatively, some of the configuration data can also be entered 
at each waypoint that the operator specifies. This will enable the 
operator to adjust parameters, such as paint speed, transport 
20 speed, paint zone, and transport zone for specific waypoints 
during the programming. 

Figure 2 illustrates the configuration data in relation to the robot 
path. Waypoints A, B, C, D, E are specified by the operator. 

25 Point A is the starting point and the process is "off" in this point. 
At waypoint B, the process is turned on. Waypoints C and D are 
specified with the same process data, such as the same brush 
type and the same color. At waypoint E, the process is turned 
off. Since the process is turned off between point A and B, the 

30 speed between those points is the transport speed v 1? with 
speed v 2 specified to the robot controller form the arc 5, in order 
for the robot tool to reach the desired speed v 2 at point B. Since 
the process is turned on between the waypoints B and E the tool 
speed between those points is the process speed v 2 . When gen- 

35 erating a robot path, the generated path should not only consist 
of straight lines between the waypoints. When a path changes 
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its direction in a waypoint the tool shall follow an arch 5, 6 in or- 
der to maintain the specified tool speed. The size of an arch de- 
pends on if the process is on or off. The process zone is the 
size of the arch 5 when the process is off. The transport zone is 
5 the size the arch 6 when process is on. The point extension dis- 
tance D1 is the distance that a waypoint should be extended be- 
fore and after the process has been turned on or off, so that the 
tool is accelerated or retarded to the desired speed and in the 
correct direction before the process is turned on and after the 
10 process is turned off. 

The actual robot waypoints will be generated based upon the 
configuration data and the obtained sequence of waypoints ac- 
cording to a set of rules described below. More specifically, a 

15 new modified sequence of waypoints are calculated based upon 
the previously, the current and the next specified waypoint. The 
method assumes that there exists a starting point with the proc- 
ess turned off and its position and orientation specified. Figure 3 
illustrates the actions taken by the system to modify the opera- 

20 tor specified waypoints. Black dots illustrate waypoints 7, 10, 
12, 14 specified by the operator. White dots illustrate waypoints 
9, 11 with positions modified by the system. Crosses 8, 13 illus- 
trate new waypoints added by the system. 

25 The waypoints 7, 10, 12, 14 specified by the operator are stored 
in a separate waypoint list (w. p. I.). This is done in order to 
memorize user specified points in case the operator at a later 
time wants to delete, edit, or add new waypoints. In some cases, 
a waypoint cannot be modified directly because its new position 

30 is dependent on the following waypoint. If this is the case, the 
point is stored in a wait-list (w. I.). Waypoints 7, 8, 9, 11, 13, 14 
to be used for generation of the robot path are stored in a path 
list (p. I.). 

35 In the following, the point generation rules will be described with 
reference to Figure 3. Upon receiving, a waypoint specified by 
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the operator is always stored in the waypoint list. Each recorded 
waypoint comprises information about whether the process, be- 
tween the waypoint and the next waypoint, should be on or off. If 
the operator specifies a waypoint 14 with "process off" and the 
5 last specified waypoint 12 is also specified with "process off", 
the waypoint is stored without any modifications to the path list. 
If the operator specifies a waypoint 10 with "process on" and the 
previous waypoint 7 was specified with "process off", a new 
waypoint 8 is added to the path list. The new waypoint 8 is posi- 

10 tion backwards, in a direction described by the current waypoint 
10 and the next waypoint 12, at a distance equal to the point ex- 
tension distance D1 previously obtained. The new waypoint 8 is 
stored in the path list. The waypoint 10 represents the event 
"turn on process". In order to accomplish that the process starts 

15 in the specified waypoint, the position of the waypoint 10 has to 
be moved. The waypoint is moved backwards in a direction that 
is determined by the current waypoint 10 and the next waypoint 
12, to compensate for the tool velocity and the delay time in 
connection with turning on the process. The waypoint 12 is 

20 moved a distance equal to the event extension distance D2. An 
event "turn on process" is generated in connection with the 
modified waypoint. The modified waypoint 9 is stored in the path 
list. 

25 If the operator specifies a waypoint 12 with "process off" and the 
previous waypoint 10 is specified with "process on", a new way- 
point 13 is added to the path list. The new waypoint 13 is posi- 
tion forwards, in a direction described by the previous waypoint 
10 and the current waypoint 12, at a distance equal to the point 

30 extension distance D1. The waypoint 12 represents the event 
"turn off process". In order to accomplish that the process stops 
in the specified waypoint, the position of the waypoint 12 has to 
be moved. The waypoint is moved backwards in a direction that 
is determined by the previous waypoint 10 and the current way- 

35 point 12, to compensate for the tool velocity and the delay time 
in connection with turning off the process. The waypoint 12 is 
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moved a distance equal to the event extension distance D2. An 
event "turn off process" is generated in connection with the 
modified waypoint. The modified waypoint 11 is stored in the 
path list. If the operator specifies a waypoint with process on 
5 and the previous waypoint was also specified with brush on, the 
obtained waypoint is stored without modifications in the path 
list. 

If the delay time is small, it is not necessary to compensate for 
10 it. In the following example the waypoints are not modified due 
to delay times in connection with turning the process on or off. 
Waypoint representing events are then stored in the path list at 
their originally obtained positions. 

15 Figure 4 shows an example of how points are added and 
modified according to described rules for a paint application. 
Black dots represent operator specified waypoints A - L. 
Crosses illustrate new waypoints B_new - K_new added by the 
system. Numbers at the waypoints represent selected brush 

20 numbers. Brush number "0" is defined as "off". Brush number 
"1", "2", and "3" are defined as "on". Paint-strokes are shown 
where paint is specified to be on, and the width of the paint- 
stroke shown depends on the specified width of the brush. The 
actions taken by the system and the result of the actions are de- 

25 scribed in the following table: 



Specified 
waypoint 


Current way- 
point 


Action 


Result 


A 


First speci- 
fied point, 
brush is "off" 


Point A is stored in p. 
I. with brush number 

"0" 


p. I. = [A] 
w. I. = [] 
w. p. I = [A] 


B 


Waypoint is 
specified with 
a paintbrush 
"on" selected 


Point B is stored in w. 
I. with brush number 

u ^ n 


p. I. = [A] 
w. I. = [B] 
w. p. I = [A B] 


C 


Waypoint is 
specified with 
brush off 


- Adjust point in w. I. 
backwards along vec- 
tor BC by distance 
"point extension". 

- Store new point, 
B_new, in p. I. 


p. I. = [A B_new Ev_B 

Ev C C new] 

w. I. = [] 

w. p. I = [A B C] 
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- Create event Ev_B, 
store in p. I. 

- Create event Ev_C, 
store in p. I. 

- Adjust point C for- 
wards along vector BC 
by distance "point ex- 
tension" 

- Store new point 
C_new in p. I. 

- Clear value in w. I. 




D 


Waypoint is 
specified with 
brush on 


Store point in w. I. 


p. I. = [A B_new Ev_B 

Ev C C new] 

w. I. = [D] 

w. p. I = [A B C D] 


E 


Waypoint is 
specified with 
brush on, 
brush type 
changed (fan 
size and color 
changed) 


- Adjust point in w. I. 
backwards along vec- 
tor DE by distance 
"point extension". 

- Store new point 
D_new in p. I. 

- Generate event 
Ev_D, store in p. I. 

- Store E in p. I. 

- Clear w. I. 


p. I. = [... C_new 
D new Ev D E] 
w. I. = [] 

w. p. I = [A B C D E] 


F 


Waypoint is 
specified with 
brush off. 


- Generate event 
Ev_F, store in p. I. 

- Adjust point F for- 
ward along vector EF 
by distance "point ex- 
tension". 

- Store new point 
F new in p. I. 


p. I. = [... Ev_D E 
Ev F F new] 
w. I. = [] 

w. p. I = [A B C D E F] 


G 


Waypoint is 
specified with 
brush off. 


Store point in p. I. 


p. I. = [... Ev_D E 
Ev F F new G] 
w. I. = [] 

w. p. I = [A B C D E F 
G] 


H 


Waypoint is 
specified with 
brush on 


Store point in w. I. 


p. I. = [... Ev_D E 
Ev F F new G] 
w. I. = [H] 

w. p. I = [A B C D E F 
G H] 


I 


Waypoint is 
specified with 
brush off 


- Adjust point in w. I. 
backwards along vec- 
tor HI by distance 
"point extension". 

- Store new point, 
H_new, in p. I. 

- Create event Ev_H, 


p. I. = [... G H_new 
Ev H Ev I I new] 
w. I. = [] 

w. p. I = [A B C D E F 
G H I] 
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store in p. I. 

- Create event Ev_l, 
store in p. I. 

- Adjust point I for- 
wards along vector HI 
by distance "point ex- 
tension" 

- Store new point 
l_new in p. I. 

- Clear value in w. I. 




J 


Waypoint is 
specified with 
brush on, 
brush type 
changed 
(color 
changed) 


Store point in w. I. 


p. I. = [... G H new 
Ev H Ev I I new] 
w. I. = [J] 

w. p. I = [A B C D E F 1 
G H 1 J] 


K 


Waypoint is 
specified with 
brush off 


- Adjust point in w. I. 
backwards along vec- 
tor JK by distance 
"point extension". 

- Store new point, 
J_new, in p. I. 

- Create event Ev_J, 
store in p. I. 

- Create event Ev_K, 
store in p. I. 

- Adjust point K for- 
wards along vector JK 
by distance "point ex- 
tension" 

- Store new point 
K_new in p. I. 

- Clear value in w. I. 


p. 1. = [... 1 new J new 
Ev J Ev K K new] 
w. 1. = [] 

w. p. 1 = [A B C D E F 
G H 1 L K] 


L 


Waypoint is 
specified with 
brush off 


Store point in p. I. 


p. 1. = [...Ev_J Ev_K 
K new L] 
w. 1. = [] 

w. p. 1 = [A B C D E F 
G H 1 J K L] 



When all the waypoints have been obtained and the waypoints 
have been modified, the actual robot path is generated based on 
the modified sequence of waypoints stored in the path list and 
the obtained configuration data e.g. transport speed, paint 
speed, transport zone, paint zone, and brush list. The robot path 
generation generates robot code comprising robot instructions 
for the movement of the robot. The path comprises a number of 
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waypoints having position, orientation, and process data, as well 
as a number of waypoints representing specific process events. 
Each waypoint in the path list has a brush number associated 
with it. 

5 

A robot code generator takes the waypoints in the path list and 
the configuration data as an input and generates a robot pro- 
gram with the right syntax for the specific robot controller. The 
robot code generator can be any robot-code generator known to 

10 those skilled in the art. The tasks of the robot program generator 
are; locating the waypoints at the right places based on the 
process and the transport zones specified, generating the right 
syntax, and translating the input to the robot to a programming 
language. The generated robot code is either downloaded to the 

15 robot controller so that the robot can execute the program or in- 
tegrated into a larger robot program as a module, in case the 
robot program contains a sequence of different objects. 

In the following, it is described how the robot code is generated 
20 based on the waypoints in the path list. A proper "move" instruc- 
tion implies a liner movement to a specified point with the tool in 
the specified orientation. The proper instruction is generated 
based upon the current process information. Before the code 
generation begins, default process parameters are read to the 
25 system and all positions and orientations specified in the path 
list are transformed from the object coordinate system to the ro- 
bot coordinate system. Thereafter, a move instruction is gener- 
ated to the first point in the path list with default process pa- 
rameters. A move instruction to the next point in the path list is 
30 generated with the process information specified in the first 
point. This last step is repeated for all the points in the path list 
until the end of the path list. Below is an example of program 
code generated for waypoint A - G shown in Fig. 4. 
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Example: 

p. I. = [A, B_new, Ev_B, Ev_C, C_new, D_new, Ev_D, E, Ev_F, 
F_new, G] 

5 

move to A, default process parameter 
move to B_new 

move to C_new with events in Ev_B and Ev_C 
move to D_new 
10 move to E with event in Ev_D 

move to F_new with event in Ev_F 
move to G. 

The robot code generated is the input to the robot controller. 
15 Fig. 5 shows the actual robot path generated based on the gen- 
erated robot instructions. 

Figures 6 and 7 are flow charts illustrating a method and a com- 
puter program product according to an embodiment of the pre- 

20 sent invention. It will be understood that each block of the flow 
chart can be implemented by computer program instructions. In 
block 20, configuration data are read into and stored in the sys- 
tem. In block 21, the system waits for new waypoints to be 
specified. When a new waypoint is specified, position and proc- 

25 ess information is obtained, block 22. In block 23, it is observed 
whether the obtained waypoint comprises information about ori- 
entation or not. If a waypoint does not contain information about 
the orientation, the orientation is copied from the last stored 
waypoint, block 24; otherwise the orientation is obtained from 

30 the pointing member, block 25. If necessary, the waypoint is 
modified, block 26. The modifying of a waypoint is described in 
more detail in the flow chart shown in figure 7. When all the 
waypoints have been received and, if necessary, modified, robot 
code is generated based on the configuration data and the modi- 

35 fied sequence of waypoint, block 28. In block 29, generated ro- 
bot code is checked, and if incorrect, it is corrected. 
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The flow chart in Fig. 7 describes the modification of a waypoint 
in more detail. To begin with, it is decided whether an obtained 
waypoint should be modified or not. This decision is based on 
whether the waypoint comprises a certain process event or not. 
5 In the example described herein, only waypoints comprising the 
process event "turn on paint" or "turn off paint" should be modi- 
fied. All the other waypoints should be stored as they are re- 
ceived. The determining of whether the waypoint comprises the 
event "turn on paint" is based on the brush status for the current 

10 and the previous waypoint. If the brush status for the current 
waypoint is "on" and the brush status for the previous waypoint 
is "off", the waypoint comprises the event "turn on paint", and 
the waypoint should be modified, block 30, 32. To be able to de- 
termine a new position for the waypoint and a new added way- 

15 point, the position of the next waypoint is needed. Until the next 
waypoint is received, the current waypoint is stored in the wait 
list, block 36. 

If the waypoint does not contain an event, i.e. if the current 

20 brush status is "on" and the previous brush status was "on" or if 
the current brush status is "off" and the previous brush status 
also was "off", the current waypoint is stored in the path list 
without any modification, blocks 38, 39. If brush statuses of the 
current and the previous waypoint are "on" and there is a way- 

25 point waiting in the wait list, blocks 30, 32, 42, the position of 
the waypoint in the wait list is adjusted backwards along the di- 
rection described by the previous and the current waypoint at a 
distance equal to the point extension distance, block 44. The 
new waypoint is stored in the path list, block 45. An event "turn 

30 on paint" is generated and a new position for the waypoint is de- 
termined based on the point extension distance and the previous 
and the current waypoint positions, block 46. The new event is 
stored as a waypoint in the path list, block 47. The current way- 
point is stored in the path list, block 48. The wait list is cleared, 

35 block 49. 
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If the current waypoint has brush status "off" and the previous 
waypoint has brush status "on", the waypoint comprises the 
event "turn off paint" and the point should be modified, blocks 
30, 34. If there is no point waiting in the wait list, block 50, the 
5 event "turn off paint" is generated and the position of the event 
is adjusted by adjustment of the position of the current point 
forwards along a vector determined by the position of the previ- 
ous waypoint and the current waypoint, a distance equal to the 
event extension distance, block 51. The new event is stored in 

10 the path list, block 52. A new waypoint is added comprising the 
orientation of the waypoint and a new position achieved by mov- 
ing the position of the current waypoint forwards along a vector 
determined by the position of the previous waypoint and the cur- 
rent waypoint, a distance equal to the point extension distance, 

15 block 53. The new point is stored in the path list, block 54. 

If the brush status of the current waypoint is "off" and brush 
status of the previous waypoint is "on", and there is a point in 
the wait list, blocks 30, 34, 50, the point in the wait list is ad- 

20 justed backwards along a vector determined by the position of 
the previous and the current waypoints, a distance equal to the 
point extension distance, block 56. The new point is stored in 
the path list, block 57. An event "turn on paint" is generated and 
a new position for the generated event is determined, block 58. 

25 The new event is stored in the path list, block 59. An event "turn 
off paint" is generated and its position is based on the position 
of the current waypoint, which is moved backwards a distance 
equal to the event extension distance, block 60. The new event 
is stored in the path list, block 61. A new waypoint is generated 

30 comprising having a new position determined by adjusting the 
position of the current waypoint forwards along a vector deter- 
mined by the previous and the current waypoints, a distance 
equal to the point extension distance, block 62. Store the new 
waypoint in the path list, block 63. The wait list is cleared in 

35 block 64. 



24 



After a robot path has been generated, it is possible for the user 
to edit the robot path. The operator can add new waypoints be- 
tween consecutive waypoints stored in the system or to the be- 
ginning or the end of list of waypoints. The operator may also 
5 edit position, orientation, or process settings of the waypoints 
and delete waypoints. When the operator wants to delete a way- 
point, the following steps need to be performed: go to the se- 
lected point in the waypoint list, delete corresponding waypoints 
from the path list, delete waypoints in the path list correspond- 
10 ing to the previous and the next point in the waypoint list, calcu- 
late and generate new waypoints, corresponding to the previous 
and the next point in the waypoint list, and delete the waypoint 
from the waypoint list. 

15 When the operator wants to add a new point, the following steps 
are performed: add the new point to the waypoint list at the indi- 
cated position, delete the waypoints in the path list correspond- 
ing to the previous point and the next point in the waypoint list, 
calculate and generate new waypoints corresponding to the pre- 

20 vious, the current, and the next waypoints in the waypoint list. 
When the operator wants to edit a waypoint, the following steps 
are performed: go to the selected waypoint in the waypoint list, 
replace point data with edited point data, delete waypoints in the 
path list corresponding to the previous, the current and the next 

25 waypoint in the waypoint list, calculate and generate new way- 
points, corresponding to the previous, current and next waypoint 
in the waypoint list. Thus, it is possible to add, delete, and edit 
waypoints according to the rules described earlier. 

30 The method according to invention is an off-line programming 
method, i.e. the method may be used outside the robot and the 
robot controller 

The present invention is not limited to the embodiments dis- 
35 closed but may be varied and modified within the scope of the 
following claims. For example, waypoints can be loaded into the 



25 



computer from an external system, e.g. a CAD application, 
from a database of stored waypoints and process information. 



